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IDENTIFIERS 
ABSTRACT 

This study was designed to further validate the 
Staats renedial reading procedures and to deaonstrale their 
generality by extending their application to a population of pre- and 
early-adolescent retarded readers. The subjects consisted of 32 
students froa fourth, fifth, and sixth grade classrooas and 16 
subjects of equivalent chronological age froa special classes for the 
mentally retarded. The subjects were assigned to eight different 
treataent groups. The eight groups were defined by all possible 
coabinations of three dichotomous factors — type of subject, type of 
reinforceaent, and -treataent. In general, the 21 experinental 
subjects participated in a manner substantiating the aotivational 
effects of the extrinsio reinforcers. The aean number of reading 
responses aade during the experiaent was over 51,000, A oean of 550 
new (unknown) words was presented with an average retention rate of 
79 percent of these words on a short-tera retention test and 54 
percent on a long-term test. The results indicated that the 
experimental subjects scored significantly higher on a 100-itea word 
recognition task and aade a smaller percentage of errors in a prose 
reading task than did the control subjects. (HR) 
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PREFACE 



A goal of this Center is to conduct both laboratory and classroom research 
in order to create knowledge, theory, and methods which will effectively im- 
prove learning in our schools. One research project, directed by Professor 
Staats, has been concerned with the development of effective training proce- 
dures. From this project comes the present report of Mr. Van Mondfrans' 
attempt to apply these procedures to the problem of training educable retarded 
school children to read. 

It is interesting to :iote not only the' success of these training methods 
but that these procedures can be used quite effectively by nonprofessional 
personnel , 



Harold J. Fletcher 
Director of Program 1 
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ABSTRACT 



Arthur W. Staats has devisecj remedial reading procedures based upon 
traditional conditioning principles (Staats & Butterfleld, 1965; Staats, 
Minke, Goodwin, & Landeen, 1967), The procedures were sufficiently 
simple and easy to administer that, in the two studies cited, nonprofes- 
sional personnel were quickly taught to administer the program. Another 
important feature of the procedures was the use of extrinsic reinforcers in 
the form of tokens which could be exchanged for money. The money, in 
turn, could be used to purchase goal objects of S*s choice. 

The present study was designed to further validate the Staats' proce- 
dures and to demonstrate their generality by extending their application to 
a population ot pre- and early-adolescent retarded readers, including 16 
experimental and 16 control Ss from regular fourth-, fifth-, and sixth-grade 
classrooms, and 8 experimental and 8 control Ss of equivalent chronological 
age from special classes for the mentally retarded. The need for monetary 
reinforcement in conjunction with the token reinforcer system was also tested. 
The program was administered by housewives recruited from the community. 

In general, the 24 experimental Ss participated in the study with excellent 
cooperation, attention, and work behaviors, thus substantiating the motiva- 
tional effects of the extrinsic reinforcers. The mean number of reading 
responses made during the experiment was over 51 ,000. A mean of 550 new 
(unknown) words was presented with an average retention rate of 79% of these 
words on a short-term retention test and 54% on a long-term test. 

The results showed that Ss taught by the Staats procedures, using non- 
professional administrators, scored as high on the Lorge-Thorriike Group 
Intelligence Test and the California Reading Test as did the control Ss. Also, 
experimental Ss reinforced with tokens performed as well as experimental S^s 
reinforced with tokens and money. The experimental Ss scored significantly 
higher on a lOC-item word recognition task, and made a smaller percentage 
of errors, in a ^rose reading task than did control ^s. There were no effects 
of type of reinforcement upon performance in the word recognition or the prose 
reading task. 

On those measures Internal to the procedures (such as error rate, number 
of responses, etc.), the performance of experimental Ss from regular class- 
rooms receiving monetary reinforcement again did not significantly differ from 
the performance of the corresponding experimental Ss receiving token rein- 
forcement. Comparisons between the two experimental groups of educable 
mentally retarded Ss did show differences in favor of those Ss receiving 
monetary reinforcement on measures of responae rate. 

It was concluded that the procedures are generally amenable to use by 
these types of Ss and to administration by nonprofessional personnel, The 
addition of monetary reinforcement to the token reinforcer system did not 
have significant effect on the performance of Ss from regular classrooms, but 
appeared to have an effect on Ss from classes for the mentally retarded. 



INTRODUCTION 



The present study is part of a continuing 
program of research directed by A, W, Staats. 
In conjunction with this research program Staats 
has suggested a general learning theory of hu- 
man behavior called an integrated-functional 
learning approach (Staats, 1965a, 1965b, 1968, 
Staats & Staats, 1963), One feature of this 
approach involves an integration of the basic 
principles of classical and operant conditioning 
and their elaboration into corrfplex theoretical 
mechanisms capable of describing and explain- 
ing complex behaviors. 

A second feature of an Integrated-functlonal 
learning approach Is the concern for choosing 
samples of behavior for scientific study which 
are more representative of the actual behaviors 
of greatest importance. In conjunction with 
these considerations the second author and biS 
associates have engaged in a variety of research 
projects. The goal of one set of studies wai. to 
answer several questions concerning some of 
the basic mechanisms of language learning anc^ 
to delimit some of the stimulus functions fv^l- 
filled by words (cf . , Staats, 19S5, 1957a, 
1957b, 1961), A second set of studies involved 
analyzing reading in behaviorlsttc terms and 
devising laboratory procedures which wuld 
allow the study of a complex problem i\uch as 
reading acquisition (Staats, 196Sa, 1968; Staat&: 
& Butterfleld, 1965; Staats, Finley, Minke, & 
Wolf, 1964; Staats, Minke, Finley, Wolf, & 
Brooks, 1964; Staats & Staats, 1963; Staats, 
Staats, Schutz, & Wolf, 1962), Certainly, 
reading acquisition and reading-problem reme- 
diation are two members of the class of behav- 
iors which one would hope to be able to explain 
on the basis of sound psychological principles. 

On the basis of previous findings and analy- 
ses, a method was devised for the treatment of 
children who, because of learning problems, 
have not been able to read normally* The 
method, which Involved a system ot extrinsic 
reinforcement employing tokens, was Initially 
tested In a study using an adolescent male 



Identified by the experimenters as a culturally 
deprived Juvenile delinquent (Staats & Butterfleld, 
1965) ♦ The subject participated for 40 hours of 
training over a 4 1/2-month period. During this 
time he Worked and attended well in the experi- 
mental training program, making over 65,000 
word reading responses. He received special 
training on 761 words he did, not know, retaining 
430 or 57% of these words on a retention test. 
He passed all of his courses In echool (the first 
time he had ever passed a course in his whole 
history); his misbehaviors in school fell off 
markedly; and his general attitudes toward 
school and school work appeared to Improve. 
In addition, achievement tests showed an in- 
crease from the 2.0 grade level In reading to the 
4.3 level. 

These results suggest that the reinforcer sys- 
tem maintained the subject's behavior over an 
extended period of time. This Is Important when 
studying the acquisition of behaviors which re- 
quire considerable time to evolve. 

A second feature of the above study Is that 
the procedures used were sufficiently simple and 
explicit that they could be administered by a 
nonprofessional. This is important in the light 
of the high cost of running a program utilizing a 
one-trainer-to-one-student ratio when profes- 
sional personnel are the trainers. 

The amenability of the procedures to adminis- 
tration by nonprofessional personnel and the 
strength of the reinforcer system received a 
further test in a study by Staats, Minke, Good- 
win, and Landeen (1967), In this study 18 
experimental subjects from regular classrooms 
and special classes for the mentally retarded 
(including some subjects Judged by the experi- 
menters to be mentally disturbed) at the junior 
high school level were presented with the same 
materials and procedures used by Staats and 
Butterfleld (1965), In this study, the type of 
instructional technician was varied with half 
the subjects receiving the reading instiuction 
from adult volunteers and the other half of the 
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subjects from high school students. The sub- 
jects participated for an average of 38.?- hours 
of training. 

In the initial plan of this study, the 18 ex- 
pirimenteil subjects were paired with 18 con- 
trol subjects who participated in the pre- and 
posttests but did not receive the remedial 
training. However, about half way through the 
experiment the Schools involved started special 
reading programs supported by the Elementary 
and Secondary Education Act Title I, Since 
several of the control subjects participated in 
this program, the control group data were con- 
taminated , making the Interpretation of the 
standardized test scores difficult. The experi- 
mental groap did not differ significantly from 
the control group on the standardized tests 
used. Along with the contamination of the 
control group data, other reasons were given 
which might possibly account for the Jack of 
differences between the groups on these meas- 
ures. These included the following suggestions: 
(1) the tests used were not sufficiently sensi- 
tive to measure those changes which had taken 
place because of the program; (2) the changes 
brought about by the program did not transfer 
to the test situation; and {3) the test-taking 
behavior of the subjects was inappropriate and 
consisted of guessing and random marking of 
the answer sheets. The authors favored the 
third alternative. On a 100-item word recogni- 
tion test the experimental group did show sig- 
nificant gains over the control group. 

An examination of tha data from the experi- 
mental group derived fiom their performance on 
the remedial reading materials showed that they 
maHe an average of 94,4 25 word reading re- 
spc ^ses. The 18 subjects were prese;ited with 
an average of 593. 5 words they did not know. 
Of these worus, on which the subjects received 
special training, 469.7 (about 86%) were re- 
tained on a short-term retention test, and 343.5 
{about 68%) were retained on a long-term reten- 
tion test. The performance of the group as a 
whole surpassed the performance of the single 
subject in the Staats and Butterfleld (1965) 
study on these criteria. 

It was observed that as the program pro- 
gressed the subjects^ reading rate increased, 
even though the materials increased in diffi- 
culty, Also, the amount of reinforcement per 
response decreased over time, The attention 
attendance, and cooperation of the subjects 
were maintained during the training period, 

A third study using these remedial reading 
procedures was conducted by Judith McBurney 
(1967) , This study wa^ designed to extend the 
procedures .to a population of pre-adolesceht , 
emotionally disturbed males * Three experimental 
and three control subjects were selected* 



Extensive testing was done to ascertain the 
changes In academic and psychological (adjust- 
ment) performance which occiirred during the 
time the experiment was being conducted. The 
experimental subjects participated for 55 ses- 
sions of approximately 30 minutes each. 

The results of the academic tests used showed 
a slight advantage in gain scores for the experi- 
mental group. Since the subjects were tested 
individually these test scores may be more reli- 
able than the test scores in the Staats et al, 
(1967) study. The small number of subjects and 
the noting of various ceiling and floor effects In 
the tests used suggest the need for caution in 
interpreting these results, The differences be- 
tweeti the experimental subjects and control 
subjects on the tests of psychological (adjust- 
ment) performance showed no clear patterns. 
On some tests the differences favored the con- 
trol group and on others the experimental group 
was favored. 

The performance of two of the three experi- 
mental subjects In the experimental procedures 
indicated that the reinforcer system was main- 
taining their behavior adequately with respect 
to attention, attendance, and cooperation. This 
finding is important when considered in con^tec- 
tion with thv> criteria for identifying the emotion- 
ally disturbed which characteristically Include 
intractability in regular classroom settings. 
The third experimental subject performed in an 
inconsistent manner frpm session to session. 
His response rate decreased as the experiment 
progressed. This Is the only contradiction to 
the trend noticed in all other subjects who have 
so far b^en administered the procedures . 

From the three studies reviewed to this point 
several Important generalizations emerge. First, 
there is evidence that the overall reinforcer sys- 
tem used is effective with a variety of types of 
subjects. In the study of complex behaviors 
which require considerable time to acquire, it 
is important tc devise a motivational system 
which will ensure adequate long-term involve- 
ment on the part of the subjects. However, the 
need for monetary reinforcement In conjunction 
with the other relnforcers Inherent In the remedial 
reading procedures has not been tested, A sec- 
ond generalization is that the remedial reading 
materials and procedures appear applicable to 
a wide variety of types of subjects, A third 
feature of the procedures and materials is their 
amenability to administration by nonprofessional 
personnel 

The procedures of the remedial reading train- 
ing Involve several types of tasks. The details 
of the various phases of training v/ill be des- 
cribed in the method section of this report. How-* 
ever, for purposes of comparison with oth^r reme- 
dial reading programs they will be briefly outlined 



here* The first phase of the training involves 
the presentation of all those words occurring 
In a given lesson which have not been previ- 
ously presented to the subject as part of train- 
ing. The words are presented singly. The 
second phase of the program presents these 
same words with other words already presented 
in earlier lessons; In this phase the new words 
are imbedded in complete paragraphs. In the 
third phase of the program the subjects read 
silently the whole story on which the lesson 
is based. The fourth phase is a comprehension 
phase in which subjects answer questions on 
the materials they have Just read. Those words 
the subject did not know in the first phase are 
also presented in a later, retention task to 
ascertain how effective the single word train- 
ing was. 

A review of several other remedial reading 
training programs will help the reader to relate 
this study to the significant work already done 
in the area of remedial reading. This is not 
intended to divert the attention of the reader 
away from the main purpose of this study which 
is to demonstrate the feasibility of applying 
basic learning principles to the analysis and 
control of complex human behavior. The reme- 
dial reading programs described below are 
those believed by Staats to characterize the 
major orientations in the area. 

Grace Ferr>ald (Fernald, 1943; Fernald & 
Keller, 1921) suggested that the effect of pro- 
viding auditory and kinesthetic cues as well 
as visual cues In letter or word recognition 
tasks would help retarded readers to observe 
words in a systematic and accurate manner. 
These extravisual cues were provided by having 
subjects write, trace and pronounce letters 
and words. She contended that by providing 
this whole constellation of Interrelated cues 
for each troublesome letter or word, discrimi- 
nation would be aided. A program was devised 
to implement the use of these extravisual cues. 

The first step of th^§ program involves the 
presentation of slnQle^ords with extensive 
visual, manual, and auditory practice. Next, 
these words are presented in phrases with 
visual, manual, and auditory practice. The 
next three steps involve progressing from read- 
ing simple stories made up from the phrases 
practiced in Step 2, through reading paragraphs 
silently for comprehension. 

Gates (1949) suggested yet another set of 
cues to aid the reader in correctly Identifying 
words. Although several types of exercises 
were outlined. In general^ the exercises may 
be described as providing contextual cues 
" . . .the setting for each new word should be 
carefully worked out so that the word is sur- 
rounded with such abundant and suggestive 



context cues that the pupil will be quite sure to 
figure out [the correct word] promptly and cor- 
rectly ^Gates, 1935, p. 272], The exercises 
Include the use of other words to provide mean- 
ing cues, pictures, coloring, and cutting and 
matching work. 

Gates also stated that as a general theory 
there is no distinction between regular develop- 
mental classroom teaching and remedial teach- 
ing. The difference in practice is one of degree 
with individual differences of more importance 
when instructing a retarded reader. Other au- 
thors have ascribed to the same point (cf.. Otto 
& McMenemy, 1966; Witty, Freeland, & Grot- 
berg, 1966). 

The teaching methods of Monroe (1932) differ 
sharply from the two general methods previously 
reviewed. Her emphasis was upon the specific 
treatment of particular difficulties such as the 
addition or omission of sounds; I.e. , phonetics 
form the basis of the approach. 

The initial training in the Monroe procedures 
Involves the pairing of letters and their most 
frequeni^ sound. As part of the training proce- 
dures the subject traces the letter while making 
Its sound. The next step is to combine conso- 
nants and vowels into simple, regular words and 
then to develop the remedial work on the basis 
of the recognition of words from their sound com*- 
ponents. The last step in the program is the 
reading of graded phonic stories based on the 
interests of the subjects. 

Kirk and his associates (Kirk, 1940; Hegge, 
Kirk, & Kirk, 1945) have also used a phonetic 
approach to remedial reading with extensive 
drill In associating visual, manual, and articu- 
latory cues with sounds. 

A third type of phonic approach is exempli- 
fied by the work of those who have developed 
various phonetic alphabets. For example, the 
Pitman alphabet of 40 phonetic letters has been 
used to teach initial reading and, tq some ex- 
tent, remedial reading. Harrison (1$64) des- 
cribes several of these studies. 1 

A fourth group of remedial readlnc| programs 
includes the more general or eclectic approaches 
of such authors as Cole (1938), Durrell (1940), 
Schonell (1948) and Harris (1956). These 
approaches offer a variety of specific training 
techniques, motivational considerations , and 
material . 

A more extensive review of the approaches 
briefly described above would show that many 
of the procedures and/or considerations men- 
tioned by the various authors are concerned 
With the problem of motivation , The suggestion 
that the motivational procedures used in the 
two studies by Staats and his associates may 
be generally applicable is important in the 
light of the apparent need for some motivational 



system whtch will support the remedial stu- 
dent in his efforts. 

A second observation about the several reme- 
dial reading approaches reviewed of interest in 
conjunction with this study is that the materials 
and procedures of the programs progress through 
stages similar to those outlined in the methods 
section of this report. This is true even though 
the various programs were developed in a rela- 
tively independent fashion. The progression 
from (1) word recognition training (sometimes 
preceded by phonetic training) to (2) the rec- 
ognition of words in context and on through 
(3) silent reading to (4) reading for comprehen- 
sion is common to almost all of the programs 
reviewed. The specific procedures and mate- 
rials of the various programs naturally differ, 
but often such a variety of materials and pro- 
cedures are offered that there is still consid- 
erable overlap across programs. It is recog- 
nized that several of the programs add Inter- 
mediate steps to the above outline, but in 
general they are built upon this basic frame- 
work . 

Indeed, it is a basic tenet of behavioral 
engineering that if one examines a situation 
in which the behavior of interest is already 
functional, the present situation is likely to 
have many similarities to the theoretically 
ideal situation as defined by the engineer after 
analysis. To illustrate this suggestion, a 
study by Hewett, Mayhew, and Rabb (1967) 
will be reviewed. An experimental reading pro- 
gram for neurologlcally impaired, mentally 
retarded, and emotionally disturbed children 
was prepared by the Neuropsychlatric Institute 
School, University of California, Los Ar>geles, 
The program was an extension of a program 
developed by BlJou and his associates (Bijou, 
19S7 , 1965; Bijou & Sturges , 1959; Birnbrauer, 
Bijou, & Wolf, 1963). 

The underlying principles upon which the 
program was built included those of operant 
conditioning and programed instruction. The 
materials used were derived from the Ginn and 
Company Basic Readers. The procedures in- 
cluded (I) four types of single word training on 
the new words (words not yet learned in the 
program), (2) phrase reading (with the new 
words occurlng amid words already presented 
in the program), (3) oral reading of the Chapter 
in the Basic Reader which contained the new 
.words Just learned, (4) a set of comprehension 
questions, and (5) discrimination exercises with 
the newly learned words. Thus^ with the excep- 
tion of Step 5 (which may be considered as be- 
longing to the general area of Step 1) the proce- 
dures are similar to the basic outline of the sev- 
eral remedial reading programs reviewed above. 



A total of 26 subjects participated In the pro- 
gram* Of these, four were labeled as educable 
mentally retarded (EMR) and one was a preschool 
normal female. The remainder of the subjects 
were classified as neurologlcally impaired, 
autistic, or emotionally disturbed. The subjects 
received training for 2S-3S minutes three times 
a week. If the performance level of a subject 
on the materials fell below 75% correct responses, 
he repeated the materials until that level was 
reached. If this criterion was not met after 
several repetitions, the subject was presented 
with an errorless training sequence which uti- 
lized very simple discrimination materials. 

The reinforcer system involved extrinsic 
rewards such as candy, money, and toys. In 
the first three sessions one piece of candy (or 
In the case of two of the EMR subjects , one 
penny) was given for each correct response. 
For the next three sessions all subjects were 
put on a 1:5 reinforcement schedule. Later, the 
subjects went to a 1;10 schedule with the ex- 
change delayed until the end of the sessions. 
A system in which checkmarks were given were 
used to keep track of the number of correct re-^ 
sponses. The checkmarks were given on a 1:1 
basis. Eventually, a 1:200 schedule for tangible 
rewards was established with the subject being 
given his choice of one 5-cent prize for each 
full card of 200 checkmarks. 

The subjects were moved through the different 
reinforcement schedules at individual rates. The 
judgment of a trained psychologist determined 
when a subject was presented a new reinforce- 
ment schedule. The authors concluded that the 
reinforcer system maintained adequate att6ntion, 
rate of responding, and sustained progress with 
all subjects. The subjects participated for vary- 
ing numbers of sessions because of dlffs^rences 
in the length of hospitalization and the availa- 
bility of out-patients. The range of participation 
was from 8 to 137 sessions. 

As part of the overall research program the 
authors explored the effect of reinforcement 
variables. The three variables investigated 
were the removal of candy, taking away candy 
for errors, and Instituting a "time-hold" ''he 
subject was given a set number of seconds in 
which to respond and no response was consid- 
ered an error) . 

It was concluded that the removal of the candy 
reinforcer had no effect. "Candy or no-candy did 
not appear a significant .factor in deterrrtinlng this 
boy's functioning, and, observed changes probably 
were due to other factors. Similar results (candy 
not a significant variable in determining subject^a 
performance) had been obtained with several other 
children subjected to the same conditions (Hewett 
et al. , 1967, p. 46)." 



Taking candy away from subjects when errors 
were made did not produce much difference com- 
pared with the withholding of rewards for Incor- 
rect responses. The "time-hold'^ variable did 
produce an Increase in the rate of responding, 
but not In the accuracy of response* 

On the basis of previous findings the follow- 
ing hypotheses were formulated for test in this 
study: 

Since the procedures used in the present 
study do not differ too greatly at an abstract 
level from the sequence of steps used in other 
already existing remedial reading programs 
(although in this case the procedures are ame- 
nable to administration by nonprofessional per- 
sonnel), it was hypothesized that there would 
be no significant differences, as measured on 
standardized achievement tests, between the 
experimental groups using the Staats' proce- 
dures and the control groups who would be 



receiving regular developmental reading training 
and/or special attention from the regular class- 
room personnel* Further, it was hypothesized 
that differences would be found in favor of the 
experimental groups on nonstandardized meas- 
ures of high face validity. 

It was also hypothesized that there would 
be no differences in test performance between 
the groups receiving monetary reinforcement in 
conjunction with the token relnforcer system 
and those groups receiving only nonmonetary 
reinforcement (points, etc.). 

Regarding experimental groups only, on those 
measures internal to the procedures (such as 
error rates, number of responses , etc.). It was 
hypothesized that there would be no differences 
between the performance of the subjects receiv- 
ing monetary reinforcement and the correspond- 
ing subjects receiving nonmonetary reinforce- 
ment • 
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METHOD AND PROCEDURES 



SELECTION AND ASSIGNMENT OF SUBJECTS 

Twenty-four experimental and 24 control 
subjects were selected to participate in the 
experiment » Of the total 48 subjects, 16 were 
from special classes for educabie mentally 
retarded students (BMR Ss) and 32 were from 
regular classrooms (NRR Ss) . The selection of 
subjects preceded In the following manner: 
The building principals of the schools involved 
in the experiment compiled a list of those stu- 
dents In the fourth, fifth, and sixth grades or, 
in the case of the EMR Ss, students of equiva- 
lent chronological age who were identified by 
their teachers as deficient in reading skills, 
All on these lists were tested using a 100-item 
word-recognition task (100-WRT). (For more 
information about this task see the section on 
Instruments.) Those students with scores be- 
tween 9 and 70 were further tested using the 
California Reading Test, Upper Primary Levels 
Form X, and the Lorge-Thorndike Intelligence 
Test, Level 3, Form A, Verbal Battery. The 
scores of 9 and 70 were used as a lower and 
upper limit, respectively, because earlier re- 
search has shown these limits to be necessary. 
Subjects with scores below 9 on the 100-WRT 
tend to have an unusually difficult time with 
the reading materials. Likewise, S.s with a 
score above 70 on the 100-WRT tend to have 
an unusually easy time with reading materials. 
The main Vurl/rile used for selection was the 
100-WRT Te&L scores . 

Teble 1 shows the manner in which the Ss 
were distributed across schools. It should be 
not^d that with a limited number of participating 
schools and appropriate S.s the assignment to 
experimental and control groups was not strictly 
random, nor was it possible to match Ss In any 
completely satisfactory manner and then assign 
the Ss within pairs in a random manner* 

Subjects were assigned to groups according 
to the following considerations: (1) try to make 



the groups as comparable as possible on the 
pretest scores with the 100-WRT Test score 
being considered most important; (2) try not to 
assign Ss in the same school to two or more 
conditions which might interact in an uncon- 
trolled and unpredictable manner (for example, 
to have some Ss in a school receive material 
reinforcement and others who do not for the 
same performance would, a priori, appear likely 
to cause severe Interactive effects): and (3) 
keep in mind the problems of logistics and ^he 
availability of instructional technicians in the 
school area . 

The S.S were assigned to eight different treat- 
ment groups. The eight groups were defined by 
all possible combinations of three dichotomous 
factors — type of subject (retarded readers from 
regular classrooms or from special classes for 
the mentally retarded), type of reinforcement 
(experimental Ss earned tokens which were re- 
deemable for money by one-half the experimental 
Ss and for points by the other half; see the fol- 
lowing section for a description of the reinforce- 
ment procedures with the control group Ss) and 
treatment (experimental £s received the StaatS* 
procedures while control S.S received Instruction 
from the regular school personnel). 

In Table 2 are shown the group means and 
standard deviations of the experimental and con- 
trol groups with respect to the pretest scores on 
the 100-WRT Test, the Lorge-Thorndlke Group 
Intelligence Test and the California Reading Test, 
There was considerable variance among subjects 
and groups* An Inspection of the groyp means 
shown in Table 2 reveals the extent to which it 
was possible to minimize the differences be- 
tween groups. Analysis of oovdriance teohnl^u^s 
, were used to analyze the posttest scores using 
the corresponding pretest scores aS the covarlates, 

SPECIAL PROBLEMS KITH SUBJECTS 

Some of the control Ss were paid for their "par- 
ticipation" in the Experiment. These §s were 
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Table 2 

Means and Standard Deviations of Pretest Scores by Variable and Groups 



Groups 


SRA-IOOTest 
(100-WRT) 


Lorge-Thorndlke 
(DIO) 


California Reading Test 
-Total Reading 


EMR-$-Exp^ 








M 


21.250 


G5.000 


2,525 


^ SD 


8,098 


8.367 


0.386 


EMR-$-Con 








M 


35.250 


68.500 


2.950 


SD 


28,547 


4.041 


0.656 


EMR-Pts-Exp 








M 


15>000 


63,500 


2,425 


SD 


7.394 


9.983 


0.250 


EMR-Pts-Con 








M 


32.750 


71.500 


2.850 


■ SD ;: ^ 


20.189 


7.047 


0.507 


NRR- $- Exp 








\A 


62.250 


78,125 


3,537 


SD 


9.982 


IU594 


0,288 


NRR-$-Gon 








M 


58.285 


86.429 


3.714 


SD'-^-^;;-,;; 


10,935 


6.997 


0.365 


NRR-Pts-Exp 










: 56.250 


81.125 


3.387 


SD 


10.068 


13.410 ^ 


0.344 


NRR-Pts-Con 








M 


56.625 


79.500 


3*600 


SD 


18.260 


10.876 


0»689 



Denotes the group of Ss who were from the EMR classes who received monetary reinforce- 
ment ($) and who received the Staats* procedures (Exp) i 
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labeled as "pdid-contror' §,s, Each pald- 
corttfol £ was paired with an S from the experi- 
mental group which received material reinforce- 
ments The paid-control Ss were told at the 
start of the experiment , ' 

You are participating in a reading experi^ 
ment conducted by the University. We are 
interested In how well you read^ For the 
next several months I will visit you and 
talk with you about your reading activity, 
When r come r will have varying amounts 
of money to pay you for your reading and 
participation in this experiment, Remem- 
ber you are to read as much and as well 
as you can, both at school and at home. 

Whenever the experimental earned an 
amount sufficient to purchase the object for 
which he was working, the same amount was 
"earned*' by the corresponding control S, There 
was a time lapse of three weeks between the 
earning of an object by the experimental S and 
the paying of the control § to insure the same 
interval between pay-offs for experimental and 
control Ss and to allow accurate bookkeeping. 

Whenever a paid-control was to be paid, 
the author went to the school where he was 
enrolled and arranged to have him called out of 
class. The S was reminded of the rea$on for 
which he was receiving the money by having 
E paraphrase the instructions given Initially 
{see above) , A receipt was signed by The 
£ was instructed to take the envelope with the 
money to the school secretary to leave it there 
until school was but. This was to pr went 
playing with the money In class and to mini- 
mize the chance of losing it ; 

The labeled '^control-points^' in this ex- 
periment participated only in the pre- and post- 
testing. Otherwise, they had no contact with £, 

One NRR paid-control S was lost from the ex- 
periment in the seventh week because she was 
severely injured In an accident and did not return 
to school. One £ in the EMR-Experimental-Pald 
group was lost after he had completed" S7 of the 
65 desired sessions * He was discontinued be- 
cause the family moved from the state. His 
mother dld 'bring him back to Madison so that 
he could participate In the POsttestlng, 



INSTRUMENTS 

The primary test used, both for selection 
and as a dependent variable, consisted of 100 
words selected randomly from the reading mate- 
rials used in the experimental sessions. This 
test was called the 100-item word recognition 
test (100-WRT) , Twenty words were selected 
from every other level of difficulty presented 



in the materials (1*2, 1,7, 2,3, 3,0^ and 4.0 
levels) out Of a pool of 4253 total words pre-* 
sented In the program. The words were typed 
on 3 X S index cards. The lOO-WRT Test was 
administered individually to each Subjects 
had to correctly pronounce the word shown them 
on the card in Order to receive credit. The order 
in which the words were presented was arranged 
such that every fifth word was from the same 
grade level, Thus, the first, sixth, eleventh, 
eto, words were from the 1,2 grade level; the 
second, Seventh, twelfth, etc. Words were from 
the 1,7 grade level,' and so on, 

The i6Q-WRT Test was initially administered 
before any of the Ss were assigned to groups. 
The same test was administered at the termina- 
tion of the experiment. 

Further protests given Included '^he Lorge- 
Thorndlke Intelligence Test, Level 3; Form A, 
Verbal Battery, and the California Reading Test, 
Upper Primary Level, Form X, The alternate 
forms (B and W, respectively) were given as 
posttests , 

A third type of test situation used in the 
analysis of the effects of the program involved 
having each S read a story from the SRA Reading 
Laboratories, Lab lo, Olive (The S-Mlnute Story 
Test), The stories were printed on 8 1/2 x 11 
paper. The number of words read per unit time 
and the percentage of mistakes constituted the 
data* The experimental S,? road one ^et of sto- 
ries at the beginning of the experiment and an- 
other set at the end, U was not possible to get 
a pretest measure on all of the control Ss, 
Therefore, for them the test was given at the 
end of tho experiment only. The stories used 
as a* posttest were exactly the same for the con- 
trol and experimental S , 

INSTRUCTIONAL TECHNICIANS 

The instructional technicians (the adults 
who administered the StaatsV procedures to the 
Ss) were selected by having the building prln-? 
clpals of the participating schools provide the 
names of adults living In their schoof district 
who had demonstrated a willingness to aid the 
school in various projects and who had shown 
themselves to be generally responsible. Of 
the 64 adults Initially contacted, 24 were In- 
terested enough to attend a meeting. Those 
women Interested in participating in the experi- 
ments attended a second training meeting in 
which they had the chance to administer the 
program under the direction of the experimenter* 
In this meeting the instructional technicians 
were further instructed In the manner of keeping 
data. Each potential instructional technician 
attended the second series of meetings for 
about l 1/2 hours. 
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A third series of meetings was held for those 
potential Instructional technicians who felt the 
need for more training. Only six women attended 
these meetings . 

Those Instructional technicians living In the 
same school districts as Ss were assigned at 
random to the g.s in their district, However, 
because of $h unequal distribution of §s and 
Instructional technicians across school dis- 
tricts it was not possible to Assign all of the 
instructional technicians to £s in their school 
districts * Thus; ; some Instructional technicians 
traveled several miles each day to administer 
the program to the Ss. Because of the time arid 
Inconvenience involved in going so far, as w^ll 
as the' cost in transportation and babysitter 
expenses, some of the Instructional technicians 
administered the program to two Ss each day* 
Care was taken to ensure that this occurred 
equally Often across the experimental groups. 
The instructional technicians wer0 paid $2.00 
an hour to cover their costs . 

The average age of the Instructional tech- 
nicians was approximately 42 years . They had 
completed an average of 13.3 years of school < 
The mean number of children In their household 
was 2. 85 1 and they were the mothers of an 
average of 3*4 children. Their husbands had 
completed an average of 13, 6 years of school- 
ing. The mean family Income for the preceding 
year was $9^500. On the basis of these des- 
criptive statlstlOs it appeared that the average 
instructional technician was a mature Woman; 
who oared for an average-sized family. Both 
she dnd her husband had an above average 
education, the family income was ilso above 
average. (AH comparisons were made using 
data from the Statistical Abs tract ^1 iM United 
States , National , Data Book and Guide to Suc - 
cess / U. S. Dept» of Commerce, 87th edition, 
1966). 

The instructional technicians were frequently 
observed throughout the course of the study. 
A special attempt was made for the experimenter 
to be present at the first few sessions when the 
Instructional technician first started working 
with her S . 

DESCRIPTION OF 
INSTRUCTIONAL MATERIALS 

The materials used In this experiment were 
taken from the SRA Reading Laboratory materials, 
Labs la, lb, lo, and Ha. The SRA Reading 
Laboratory consists of stories developed for 
and grouped Into grade levels. For the purpose 
of this study, stories were taken from the 1 .2 
(20 stories), 1.4 (60 stories), 1.7 (20 stories), 
2.0 (32 stories), 2.3 (12 stories), 2.6 (12 sto- 
ries), 3.0 (32 stories), 3.5 (32 stories), and 



4»0 (10 stories) grade levels. Once a particular , 
Reading Laboratory was selected for inclusion 
at a given grade level; all the stories at the 
grade level were presented In sequential order 
(with the exception of *he 4.0 grade level/ where 
only the first 10 stOrlesi from Laboratory Ila were . 
presented) , The different number of stories at 
the various levels was a function of the attempt 
to control the rate of inti'pduction of new words, 

It should be mentlonei that materials other 
than the SRA Reading Laboratories could have 
been used. However, the SRA stories have sev- 
eral features which make them attractive for the 
purposes of this study. First, there is a some- 
what controlled introduction of new words in 
each lesson. Second, a set of comprehension 
questions Is available for each story ♦ In addi- 
tion, as grade level increases, the stories be- 
come more difficult, they are longer overall, and 
paragraph length Increases. This resulted in a 
gradual decrease of the average amount of reward 
delivered for each response . 

The first step in adapting materials for this 
reading training program was to make a running 
list Of neW words that appeared in the stories 
Each word I or form of a word (past tense , plural , 
etc.), that had not occurred in a previous story 
was added to the list . From this list the new 
words that occurred in a given lesson were typed 
on a separate 3 x 5 index cdrdi Bach paragraph 
was typed on a 5 x 8 index card. The Complete 
story and the comprehension question^ were 
typed on separate 8 1/2x11 Sheets of paper, 
These comprised the materials which ^vere pre- 
sented to the student during the training. In 
addition, data sheets were prepared for each 
lesson, These data sheets were used by the 
Instructional technicians* 

}n addition to the individual lessons, each 
instructional technician was furnished with a 
packet of materials which included pencils ^ 
paper clips, rubber bauds. Vocabulary Review 
data sheets, 100 each of yellow, red, and blue 
tokens, and charts for plotting the money or 
point value of the tokens delivered each day. 
The uses to v/hlch these materials were put are 
Illustrated and discussed at the appropriate time 
in the following sections. 

PROCEDURES 

Each lesson consisted of four phases: Indi- 
vidual Word Phase, Oral Reading Phase, Silent 
Reading Phase, and Comprehension Phase. These 
phases are Individually discussed In detail below. 

Individual Word Phase 

The first phase consisted of the individual 
presentation of each word that occurred In the 
lesson being covered and that had never before 



been presentect in the program. Each word was 
> presented on a Separate 3 x 5 index card. The 
words were presented to S one at a time; and 
S was asked to read th^m. 

The first time through the stack of word : 
cards for a given lesson / every correct read-; s 
Ing of a word was rewarded with a yellow tokei 
(worth 1/5 of a cent or two points) , Whenever 
; a card was read correctly, it was removed from 
the stack. If S read a word incorrectly, or did 
not read it at all, the Instructional technician 
told S what word was typed on the card* The 
S was th0rt to repeat the word while looking at 
It. If S was not looking at the word when he 
responded; he was required to look at the word 
and say it again . When S had properly re- 
sponded to the card after being prompted, it 
was returned to the group of cards still to be 
presented/ No. token was delivered at that 
time, 

After having gone through the original stack 
once using this procedure, the stack (with the 
correctly given words removed) was presented 
again to S, and the procedure was repeated 
(i»e . , words which ^ read incorrectly were 
prompted, but not rewarded, and then were 
returned to the stack for later presentation). 
On the second, or subsequent presentations of 
the words , a blue token (worth l/lO of a cent 
or one point) was awarded contingent upon a 
correct reading response. When there were no 
more cards in the stack, i.e. , when ^ had read 
each word correctly once, without prompting, 
the Individual Word Phase was ended and the 
Oral Reading Phase was instituted. 

For Information concerning the data-marking 
procedures for this phase and the other three 
phases the reader is referred to the administra- 
tion manual (Staats, Van Mondfrans, & M^nke, 
1967). 

Oral Reading Phase 

Each paragraph of the story being presented 
was typed on a 5 x 8 index card. These para- 
graphs were presented in the order they appeared 
in the story* When S read the entire paragraph 
without an error, he received a red token (worth 
1/2 cent or 5 points) . When S read a word in- 
correctly on the card, the instructional tech- 
nician pointed to the word, and S was to repeat 
the word while looking at It. AfFer ^ finished 
a card upon which errors occurred, the card was 
put aside (with no token delivered) and presented 
again after the remainder of the cards had been 
presented. When errors occurred on two or more 
cards the first time through, all the missed 
cards were presented again before a third trial 
on any card took place, A paragraph was re- 
peated until S had read It through in its entirety 
without an error, at which time a yellow token 



was earned, When all of the paragraphs in a 
Story had been read correctly, the tokens which : 
S, had earned were given and the next phase of 
the training was initiated, ' 

Silent Reading Phase 

Following the Oral Reading Phase, S was 
given a sheet containing the story appropriate 
to the particular lesson upon which he was work- 
ing . These stories were typed On 'regular 8 1/2 
x 11 sheets of paper. The S was Instructed to 
read the story silently and was told that it was 
important to read to understand the story So that 
he could answer questions* 

The instructional technician watched S closely 
to insure that he was actually reading the story. 
If it was apparent that g was not carefully attend- 
ing to the story, th-^ Instructional technician 
required him to read aloud during this phase on 
subsequent lessons. It was found that reading 
aloud in this phase for several sessions resulted 
in adequate attention on the part of S SO that he 
subsequently was allowed to read silently. 

The was given four yellow tokens lapon the 
completion of the story ^ at which time the next 
phase v/as instituted . 

Compreiiension Phaie 

Tho comprehension questions used were those 
which accompanied the SRA stories adapted for 
this program. They took one of two forms: Some 
of the questions required a written answer, and 
some were of the multiple^chblce type. In either 
case, S wrote his answers (or circled his an- 
swers) to thfc comprehension questions and then 
handed them to the instructional technician. For 
each correct answer, a red token was earned. 
If a spelling error had been made when a Written 
answer was required, g was to correct his an- 
swer, and then a yellow token was earned. For 
incorrect answers S reread the appropriate para- 
graph and corrected his answer, at which time 
a blue token was earned . All the tokens earned 
were presented at the end of the phase. The end 
of this phase marked the completion of the les- 
son. At this point the whole procedure was 
repeated with the next lesson in the series . 

Vocabulary Review 

Some of the words presented in the Individual 
Word Phase of the procedure were words that §^ 
already could read * Many others , however , 
were words that the procedure was Intended to 
teach. Short-term retention of these new words 
was assessed through an analysis of errors In 
the Oral Reading Phase. The Vocabulary Review 
assessed the long-term retention of words which 
were Initially unfamiliar to S. In most cases, 
the Vocabulary Review was presented following 
every twenty reading lessons* However, with 
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iS'omeSs, particularly the EMR Ss I so many 
jwords were missed that tho Vocabulary Review 
was givon every ten lessons. The Ss who 
j^riecessUated the change were the slower Ss, 
sc the actual span of time between Vocabulary 
Reviews for them was similar to the span of 
tim6 for the faster students V«?ho received the 
^Vocabulary Reviews after every twenty lessons* 
:The Vocabulary Review dealt only with the words 
which were presented in the immediately pre- 
ceding twenty lessons (or ten lessons) and not 
in all the lesson's presented to that time* 
l-i The materials necessary for the Vocabulary 
v Revlew were prepared from the materials us$d 
in the Individual Word Phase of each lesson* 
Each day/ after S had left, the Instructional 
^ technician set aside the individual word cards 
on which errors had been made during that ses- 
sioni These words were itemized on the Vocabu- 
lary Review data sheet, By doing this daily ^ 
the data sheet v/as completed by the time the 
Vocabulary Review was presented* 

At the end of each twenty lessons (or ten 
lessons) the instructional technician combined 
the cards which had been set aside from each 
lesion into a single stack (in the order Irt which 
th3 words appeared on the Vocabulary Review 
data sheet). TKe Vocabulary Review was then 
administered in the same manner as the Indi- 
vidual Word Phase of the individual lessons. 

Th^ Token System 

An important aspect of this study was the 
use of a motivational system consisting of the 
awarding of tokens, contingent upon correct 
responding, which were exchangeable for vari- 
ous rewards, Three colors of tokens were used, 
each color representing a different value, Thus, 
a blue token was worth I /1 0 of a cent or I point? 
a yeliovy token was worth 1/5 of a cent or 2 
points; and a red token was worth 1/2 of a cent 
or S points . 

Each experimental S in the material reinforce- 
ment groups, indicated to his instructional tech- 
nician some object for which he would like to 
work, Such as a phonograph record , hair cream, 
a pair of shoes, and so on, and the Item^s 
exact price. When g. had earned tokens whose 
monetary value equaled the amount necessary 
for the purchase of the item, he was given the 
money and allowed to buy the item. 

At the end of each session the monetary or 
point value of the tokens earned was computed 
using computational guides provided on a graph 
and added to the amouiit which had been earned 
in previous sessions. This amount was then 
plotted on the graph , For best visual effect, 
6 bar graph was used. For the experimental 
groups receiving monetary reinforcement, each 
time §. earned his payoff a new progress chart 



was started, If ron the day the S reached hlS 
criterion, he earned tokens worth more than the^^;; 
object for which he was working cost, the addi*^;- 
tional amount was entered immediately on the 
n&v^ chart, For the experimental groups receiv- 
ing only points, the point value of the tokens 
was entered on the graph. This constituted the 
only formalized reinforcement other than tokens 
these Ss received, t?}. 

The" proper use of the graph involved entering 
S's progress in his presencei with substantial 
positive comment and approval on the part of 
the Instructional technician/ Regardless of the 
amount of money or points S had e«*rned durlr»g 
the session, he was made to feel that he had 
performed well. 

6oi\M$ System 

In the earlier sessions the stories were rela- 
tively easy and Ss could ,earn many tokens , As . 
an S progressed in the program, the stories be- 
came harder and longer , and more respon$es 
were required per unit reinforcement in the Oral 
Reading r Silent Reading, and Comprehension 
Phases. In order to. lessen the abruptness of 
the drop in earnings a bonus system was intro- 
duCed. those instructional technicians whost- 
Ss were earning considerably less than 200 points 
or 20 cents per day were Instructed to reward any 
sequence of unusually good behavior with an 
extra token. For example, if $n S consecutively 
read several difficult words in the Individual 
Word Phase without an error the instructional 
technician vyould give an extra r^d token. These 
bonus tokens were tabulated separately by the 
author but were included In the graphs and totals 
by the instructional technicians, The total 
amount earned by the S would be the sum of the 
bonus tokens and the tokens actually earned by 
participating in the regular program, 

Th(B Session 

Although the decision as how long to 
work with Ss each day Was a somewhat arbi- 
trary one, for various reasons a one-half hour 
period of actual reading each day was the 
length of the session for this research, This 
one-half hour period corresponded convenieiitly 
with the periods irt school, it Is the time 
period used by earlier researchers In this pro- 
gram (Staats & Butterfield, 1965; Staats et al/, 
1967), and this time period provided the in- 
structional technicians with sufficient time to 
set up and cleanup materials, etc. and still 
not spend more than an hour away from home, 
This one-half houi period Included only the 
time spent on the actual reading of the lessons 
and did not include the time required to set up 
the materials, enter the day*8 earnings on the 
graphi and so on. 
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V*%Uyi moro than one lesson wes covered 
in any 8h© session, Occasionally, S. had pro- 
crossed only part way through a lesiOn before 
the time ejapsed, There were two permi$sibie 
stopping places wUhIn a lesson— after the 
Individual Word Phase or after the Oral Read- 



ing Phase, Stopping after the Silent Reading 
Phase would result in an Inflated error rate in 
the Comprehension Phase. When a lesspn was 
split across two sessions , two data sheets 
were used to facilitate the compilation of the 
data, 
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RESULTS 



.THE RESPONSE DATA 
iHtERNAL TO THE PROGRAM 

The reading responses of each £ In the 
ex06rlipenta][ qrouf>$ were carefully tabulated , 
The performance of the four experimental groups 
were compared on various measures slich as 
total number of reading responses made, num- 
ber of word^ rnlssed the f|r$t time they were , ii 
presented, and number of words missed after ' - - 
training . v^cX-.^ "wv ^ '^^11 

Each^ experimentai S ^larticipat^^ 
training sessions of approximately 30 minutes 
duration (with the exception of one |. In the 
EMR-Monwt^perimerttal group who finlshi^ 
.57 $6^siot^$ before he was terminated In the 
program because of moving) • 

Th0 Total Number 

of Red()iiig Responses ^^ ' 

V,?; TKe total number of reading responses made 
by S$ varied greatly, The in the EMR- 
Money- Experimental group made an average of 
40,4^9 reading responses (SD « 3,971 ,74). 
This was 68% more reading responses than the 
mean number of responses made by the Ss in 
the EMft-Polnts-£:xperlmental group (X =»^24,045; 



SD a 12,791 ,86). The comparlsori of the two 
NRR groups showed thM the NRR-Polnts- 
Experlmental group made 9 , 3% more reading . 
responses oh the average (>f « 62,779; SD « , 
14,615,96) than the MRR*Money-Experlmental 
group (J< «» $7,418; SD « fO,67$*7S). The 
above differences were an^lyzfed using covarlate 
technlquei with the 10?)-WRT pretest scores as 
the covarlate (see Table 2) and the group means . 
for the total number of reading responses made 
as the criterion variable. As can be seen In 
Table 3, the effect of Type of Subject was sig- 
nificant, P (1,19) « 4,45, fi< .OS, The Inter- 
acU?)n between Type o^ Subject and Type of 
, Reinforcement was also slgrisficant^ P (l >|9)« : 

©■|^^4iiB^'^^^^^^^ 

The cumulMlve group averages of thV^ 
number ef readljig responses made per session - 
are pre$ented in Pigufe I > These curves Include 
the woYds reaa m all the' phases of the program* 
As can be se^en.from th^Jl^ure/the curves for { 
three bf tH^ hyt groups (the Eji|R Joints group 
excepted) show positive acceleration (at lea$t 
during the first 40 sessions), f Ij^riS Irtfe 
though as g.s progressed (n the program t)ie read- 
ing materials became more difficult, The curve 
for the EMR Points group is essentially a straight 
line. 



Table 3 
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Analysis of Covarlance Summary Table with Total Reading Response; 
• as Criterion and lOO-WRT Pretest Scores as the Covarlate 




Source 


df MS 




F 



70,000 - 



60,000 ^ 
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10,000 - 
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Figure I * Ihe Cumulative Mean Number of Reading Responses as a 
, Function of Sessions Completed for the Four &.perimental 
Groups, 



Wofds Kn6wn uf>6n Flrit PrftsenUtlon 

Records wej-e kept of the number of words 



the course of this experiment, Of these, an 
average oiM^n were known to the Ss (44%). 
T!\]^ reminder Of the wprd£ were mlfl^id inftially. 

artdth^Sr^tljf^^^^^^ 
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average of M90,5 di(ferent words of which 
■ 807 or S4% wi^re Initially known. On the first, 
♦ short-term retention tests 69% of tho words 
§,s wero trained on were retained, The data 
from Vocabulary Reviews showed that 46% of 
the words Initially missed in the Individual 
Wotd Phase were retained on this long-term 
retention test^ 

the Ss In the NRR- Point s-Exp^jimental 
: group were presented with an average of 2119,6 
words In the Individual Word Phase, They knew 
an averageof l462»l (74%), The percentages 
retained on the two retention tests were 72% 
oh the short-term test and 63% on the long- 
term test. 

> The in the NRR- Money- Experlrnental 
group were presented with an average of 2102,1 
words of which they knew an average of 1703,17 
(81%) initially. On the short term retention 
test 83% of the words the Ss were trained on 
were retained, The percent retained on the 
iong*term retention test was 67%, 

The Amount of ftelnfofcement 
Per Residing Response 

V ' As the number of lessons the Ss had read 
Iftcreased, the length of the lessons irtcreased, 
ThU wa$ particularly true of the Oral Reading 
Phase and Silent Reading Phase of the lessens . 
Ifjie result of this incieas^ was a gradual di*op., 
' iji the amount of reinforcement per readlrig 
^ response across sessions* The average nu^n*- 
ber of points earned or the average amount of 
money earned in a session by a group was 
, divided by the number of reading responses ~ 
5-tftade In that session, The resultant ratio was 
called the '^payrate," Since some Ss received 
money for the tokens awarded and other Ss re- 
ceived points, the payrate could be expressed 
in cents Qt points. In Figure 2 the average 
1 payrate for each experimental group across 
sessions is given. The numbers on the ordi- 
nate are in cents per response. For example 
the number ,0S on the ordinate should be read 
"five-one hundredths of a cent and would be 
equivalent to five-tenths of a point. 

From Figure 2 it is clear that the payrate for 
thre^ of the four experimental groups (EMR- 
r Points group^ excepted) decreased as the oxperi- 
: m^l)t^'l>rogr The curve for th6 EMR-Points 

^ girMplr^liUe irregular , 
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posttest scores and the gain scores are shown rm-- 
for all the tests given, The gain scores are 
defined as the mean score of a given group on ^-'^y 
a particular posttest minus the group mean on ':u-v. 
the corresponding pretest. The sign Is retained- 
to show the direction of the differences. The ^^^^ ■ 
two scores analyzed from the Five-Minute Story, 
the percent of errors made (% -Error i) and num- 
ber of words read per minute (VV/Min) did not 
have a corresponding pretest for the control 
groups so no gain scores are given, 

Tho Lorge-Thorndike Group 
Intolligence Test 

An analysis of (x^varlance with the posttest 
scores as the criteriort and the pretest scores 
as the covariate for the Lorge-Thomdlke DIQ 
scores, showed no significant differences 
(Table 5). The group means for this instrument 
are presented in Tables 2 and 4 for the pretext \ " 
and posttest scores, respectively. 

The California Reading To$t 

An analysis of covarlance summary table for / 
Total Reading scores from the California Reading 
test is presented in Table 6, Th6 group means 
analyzed are presented in Tables 2 and 4, The 
three-y/ay interaction involving the effects bf 
Type of Subject, Type of Reinforcement^ and 
Treatment app^roached significance, F (1 ,36) ^ 
, 4.089, £« 4,19 needed at ,0S levels This re- 
flects th0 fact that the me^n gains evidenced . 
bV th0 various experimental ^nd control groups 
were not uiilform in magnitude, ^ The largest 
mean gain was made b/the NRR- Experimental- . , 
Points group (♦463 years) , The smallest mean - - 
gain Was made h^tUe, EMR-Control-Mcney group 
(4ISO years), The second largest gain involved 
the NRR-Ck>ntrol-Money group with the second > 
and third smallest gains involving the NRR- j 
Control-^^oints and NRR-Experimental-Points 
groups, respectively, Thus, although the vari-* 
ance between the groups was significant, no 
consistent pattern was dbvlous. Comparison^ 
Of the experimental groups and the conrespond- 
Ing control groups showed that In two cases the 
difference in mean gains favored the experimental 
groups (BMR- Experimental-Money group 6v6r the 
EMR-Ck)ntroP%n^V Ofoup by ,175 year^plfftk- 
Experim^ntai-Pofhts group pVdr the NRft-'Ccfni^^ 
Points group by ,2?6 years) and in' two ibases 
the confrbi groups were favored (fii.?(R^C5ohtrol- . 
Points gro^P 6 ver BK!ft-lE:>cperimerital-Po 
by ado ?^lff N)^l^p^fi^^ 
NRR-Experlme'ntai->rfon# gfou^ Ey^UtfS years) , 

In tatle 7 thfV^5tilt§ lf#knlt?^^^^^^ 
ance wlthhhr ib(f-WRT posttest sbores as the 
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Figure 2, The Payrate (amount of rolnforcement including l^onUsos 

per reading r^spons^) as a Punctfori of Sessions Completed 
for the Four E^^perlmental Groups/ The number ,05 on the 
ordinate equals five one^hundredlhs of a c^nt or five-tenths 
of a point, :l - 



criterion and the lOO-WRT pH^eteat scores as 
the oovarlate are shown, The corresponding 
group means are presented ih Tables 2 and 4, 
The effect 6jf Treatment was statistically sig- 
nUlcantf^^^^^^^^^ « 4.86, fi^ < .05i An ins pec- 
Vl^l'of IH& gt^^^^^^ scores fof this 

vffi^Bk^hbws thaf'^^^ is Ift favor 

of the ^experimental groups. 

Jh^ thf^fW^Y ifi<6Mtfg^ff,trf fpr 6f SubJ ect , 

£ir;^iy|!|ia5; fhi$ y^Hects the 

fact thai Wlalni 6videncfed bV IheV^Vldlis 

riiwiiiiiiifii^ 



ttie EMR-Experimental-Money group to a low of V 
n v25 for the NRR-Corttrol^Polnts group. Of the 
four comparisons Involving an experimental group 
and its corresponding control group, three ar^ 
consistent with the 6veraU treatment Effect , 
whereas on^ {involving th^ two iettf^-Poirtt$ 
gt'oUjJs) if not* TJi^'fnean '<}l(t^rdnc^ in gain 




Reinforcamiht weii n6t signlficahi. 
Test Wefe fro¥tf\e Sfc^ Reading labors tofV# 'lo, 



Table 4 

Means and Standard Deviations of Podtlest Scores and Gain Scores {GS)^ by Variable and Groups 



California 





SRA 100-Words 


Lorge-Thorndlke 


Reading Test 


5-Mlnute Story 


EMR-$-EXp 


1 00-WRT 


GS 


DIQ 


GS 


Total 
Readlno 


GS 


W/Mln 


% ElTors 


















M 
SD 

EMR-$-Con 


44.750 
17.366 


23.500 


69,000 
9,557 


4.000 


2.850 
0.387 


0.325 


48.500 
23.770 


13.650 
10.290 


M 
SD 

EMR-Pts-Exp 


47.500 
29.961 


12.250 


69.250 
5.439 


0.750 


3.100 
0.535 


0.150 


60.600 
37.249 


18,300 
17,847 


M 
SD 

EMR-Pts-Con 


29.^00 
16.299 


14,500 


64.250 
10.210 


0.750 


2.675 
0.466 


0,250 


31 .350 
3.873 


17.075 
8.526 


M 
SD 
NRR-$-Exp 


49.250 
18.118 


16.500 


74.750 
2,062 


3.250 


3.20'0 
0.527 


0.350 


42.400 
9.812 


12.400 
10.135 


M 
SD 

NRR-$-Con 


82.125 
9.311 


19.875 


80.750 
10.236 


2.625 


3.850 
0.338 


0.313 


72.375 
18.153 


3.783 


M 
SD 

NRR-Pts-Exp 


76.571 
12.594 


18.285 


88,000 
7. 211 


1.571 


4.129 
0.390 


0.415 


74.086 
22.563 


5.486 
2.938 


M 
SD 

NRR-Pts-Con 


75.875 
11.395 


19.625 


79.625 
11.795 


-l.SOO 


3.850 
0.478 


0,463 


66.900 
18,961 


4,387 
2.043 


M 
SD 


67.875 
15,579 


11 .250 


79.250 
11.068. 


-0,250 


3.787 
0.594 


0.187 




7.262 
4,966 



»'Galn Score'' Is the group mean for that measure on the posttest minus the group mean on the 
corresponcilng pretest 



Table 5 

Summary Table for Analysis of Covarlance with 
: Posttest DIQ Scores on the Lor^e-Thorndike 
Group Intelligence Test as Criterion and Pr^>* 
test DIQ Scores as Covarlate . 



Table 6 

Analysis of Covarlance Sumrpary Table with 
Posttest California Reading Test, Total Read- 
ing, as Criterion dnd California Reading Test, 
Total Reading^ Pretest as Covarlate 



Source 


df 


MS 


r 


Type of 
Sub/ect (S) 


1 


34.304 


0.i07 


Type of Rein- 
forcement (Rf) 


1 


64.452 


1.705 


•^fiS&tment (T) 


I 


12.211 


0.323 




1 


29.195 


0.772 




1 


0.097 


0.003 




1 


iiim 


0,340 


iHliiilil; 


1 


34.??1 


lilllli: 






;-"3f.8lO 





Source 


df 




F 


Type of 
Subject {S) 


1 


0.203 


3.010 


Type of R6ln- 
forcerrtent (Rf) 


1 


0.004 


0.056 


Treatment (T) 


1 


0.014 


0.214 


S X Rf 


1 


0,026 


Oi391 


$ X T 


1 


0.020 


0.29S 


Rf xT 


i 


V 0.067 ; 


0.9^3 




I 


liiiifiii 






■38 


■ Wot? 





,05 



plliillSiliSI^ 



illiiiiliiii^ 



Toble 7 

Analysis of Covariance Summary Table with 
lOO^WRT Posttest Scores as the Criterion 
Variable and lOO-WRT Pretest Scores as the 
Covariate 



Table 8 

Analysis of Covariance Summary Table with 
Words/Minute Scores from the 5-Mlnute Story 
Test as Criterion and Pretest Scores on the 
lOO-WRT as the Covariate 



\'[ Source 


df 


" MS 


F 


Source 




^ MS 


F 


1 y pe Oi 
Subject (S) 


1 


25.289 


0.485 


Type of 
Subject (S) 


I 


256.575 


0.985 


'\ Type of Rein- 
forcement (Rf) 


1 


138.609 


2.656 


Type of Rein- 
forcement (Rf) 


1 


596.258 


2.288 


Treatment (T) 


1 


253.552 


4.859* 


Treatment (T) 


1 


3*463 


0.013 


S X Rf 


1 


3.433 


0.066 ' 


S X Rf 


1 


239.956 


0.921 


' I S X T 


1 


5.120 


0,098 


S X T 


1 


50.085 


0.192 


Rf X T 


1 


0.231 


0.004 


Rf xT 


I 


159.934 


0.614 


;f ; S X Rf X T 


1 


263,594 


5.052* 


S X Rf X T 


1 


11 .622 


0.045 


Within Cells 


38 


52.180 




Within Cells 


38 


260.581 





* fi< .05 

Olive, 2, They were at the same general 
level of reading ability . • 

The posttest scores for the experimental 
and control groups on the 5-Mlnute Story Test 
were analyzed using the pretest scores on the 
lOO-WRT Test as the covariate to reduce the 
variance attributable to initial reading ability 
as measured by this test, The group m^ans 
on the 5-Mlnute Story Test are presented In 
Table 4, The group means for the pretest 
scores on the lOO-WRT are presented in Table 
2, The stories involved In the test were e>c- 
actiy th^ same for the experiment and control, 
groups* The analysis of the W/Min scbres 
(total number of words read irt iive minutes 
divided by five) yielded no significant effects 
CTable 8), The largest P ratio was for the Type 
of Reinforcement effect, £ (1,38) «^ 2,268, 
F =* 4.10 needed at ,05 level. Thus^ the group 
means did not differ significantly with respect 
to reading rate at the end of the experiment. 
(It was interesting to note speciflc^llV that 
be6ause of large individual differences within 
groups the effect of l:yti& of Subject did r^ot 
approliC)i flgnificance. There was oon$ldereible 
overr^|> In the number of Words read per minute 




soores^ from the 
Wtp:V6fffft^^^ errors 



Ot'oups, £ (1,38) « 4,524, £< .05. The sum- 
mary of this analysis of covariance is presented 
in Table 9; The three-way interaction Involving 
the effects of Type of Subject, Type of Reinforce- 
ment, and Treatment approached significance, 
F (1,38) « 3.025, £< .10. Of the four compari- 
sons between the experimental groups and the 
corresponding control groups, three were con- 
$.lstent with the overall treatment effect and 
favored the experifrtental groups. The compari- 
son inconsistent with the overall Treatment 
effect involved the two EMR-Polnt6 groups, In 

Table 9 

Summary Table for Analysis of Covariance 
With %-Errors on 5-Minute Story Test as 
Criterion and Pretest Scores ori the IpO-WRT 
Test as Covariate 



Source 


df 


MS . 


F 


Type of 
Subject {S) 


1 


14.539 


0.603 


Type of Rein- 
forcement (Rf) 


1 


IS. 299 


0/635 


Treatment fr) 


1 


109.059 


4.524* 


S k if 


1 


18;280 


0.?^8 


S xT 


I 


40.399 


1.676 


ilf XT 


1 


1.888 


0.678 


S x'l;f it' T 


1 




3.025 


Within C6H9 


38 







mm 



magnitude the differences In %-Errors per- 
formed by the experimental groups and the 
corresponding control groups averaged 16.9% 
fewer errors by the experimental groups. If 



the orte reversal of the trend is removed from 
consideration the average difference Is 31 .3% 
fewer errors performed by the experimental ' - 
groups , 



IV 

OtSCUSSION AND CONCLUSIONS 



TEST RESULTS 

Th« Stan<lardlie<J Test Results 

No significant differences were found be- 
tween the experimental and control groups on 
the Lorge-Thorndike Ini:elligence Test wheo the 
pretest scores vVere U30d as a covarlate, An 
analysis of covarlance with the California 
Reading Test, Total Reading, posttest scores 
as criterion and the pretest scores on the same 
test as covariate yielded one significant effect; 
The three-way-lnteractlon of Type of Reinforce** 
meat, Type of Subject, and Treatment was sig- 
nificant » This effect Is due to the differences 
between the gains of the individual groups on 
this measure, No meaningful pattern was 
obvious* 

The lack of significant Treatment effects as 
measured by these two standardized tests is 
important. Staats et al, (1967) also failed to 
demonstrate Treatment effects on similar meas- 
ures, In Staats and fiutterfleld (1965) the single 
S Involved did show large gains on a standard- 
ized reading achievement test. 

Several reasons for the lack of significant 
Treatment effects may be suggested, staats 
et aU (1967) suggested three possible expla- 
nations: (l) that the training produced effects 
Which did not transfer to the test-taking situa- 
tion, (2) that the tests used were insensitive 
dependent variables unde; these conditions , or 
(3) that the^s* te$t-taklng behavior wa^ at 
fault i j'ThVr^ut^^^^^ the third explana- 

tion iri fhferpretfn^ their d^ta . 
. In this study the werd' tested ih small 

n^^p^ . 

;p}}i^h.' t6n$(simyM^ et blV (1567), 
jrts:|u9^ested\fil^^ a$ those USdd 

rw:fi6c4on$ll^^^^^ Of Ss' 

iiwtMm populaticYii^d? ificluded at all) ; 



The effects of such variables as the general 
motivational states associated with school varia- 
bles, socioeconomic variables, and test-taking 
behavior appear stronger than the effects of the 
program on such tests, 

The Nortstandardlx^d T^st Results 

Two different tests which were devised by 
the experimenters from materials were ad-. 
ministered to the Ss , The first measure (100- ' 
WRT Test) wds previously used by Staats et aj/^ 
(1967) and McBurney (1967) In selecting ^s and 
as a dependent variable. In both studies the 
mean gain scores of the experimental Ss were 
greater than those for the control §.s, ^ 

In the present study an analysis of covarlance 
With the pretest scores on the 100-WRt Test as 
the c^variate and the posttest scores on the 100- 
WRT Test as the criterion variable yielded a sig- 
nificant Treatment effect with the experimental 
i$ showing greater gains. Since the \00 vypr^s 
which formed the test were rahdoftjif llli^l^^^ 
from five of the ten levels of dlfflcurt? Ve>re-: 
sented by the materials, it Is suggested that 
each word gained on the test Indicates a larger; ^ 
gairi it) overall reading vocabulary, Although' 
4253 words were presented in the Individual .1% 
Word Phase In the total set of materials , none 
of the Ss finished all of the stories/ thus^ the 
average EMR §. either knew or was trained on 
approximately l UO different v/prds presented in 
the program and the average NRR §, either knew 
or was trained on approximately 20?0 different 
words. Withlrtthi^ framework average increases 
in the ndmber of word 6 responded t& (Mti6xii'6n 
the lOOfWRt Test pf 1051% for the mk m%h^ 
merttal W cohtrol Ss 

const lttiUf Wlm|>^^^^ ] ThV perc^iftage 

gains f6r tke l^PtR groups were smaller '^ItFlHe 
mk experimental l^aWlf ihf W«If'^^^^^ 
an averac^e 6f in v^n\i^T^^^^ 

three-way Irtr^^actlbn M th^e^ type of Siiblect , 



iiii 



T>. '.tVP#' S( S^iK'orceih^nt , «)id treatment . the 
"dmet^nb^s Hi6^g tHe gains oi the individual 
.. $Vo\ips <H'd MX present a meaningful pattern. 

'A s>dOhd r^^j)i|i.t«ihddrdlised test with high 
; iic^ MiMw^tid Adiiilnlstered . this test (5- 
Mlnute Story Test) consisted of having each S, 
' ;,i*^^^ejtjj>I prds'e materl&U while the e.xperl*-. 
; "- ^'etttCTWo^rded f^adin^ ^rtoi fates . ' - - * 
. mWSf mjiJimi >r^rcoftt?^>T qtf>iip$ were 

4xperlnieht,° The 100- 
. ^„ ^ . J^ies w^re "used as a covari- 
$iWih pSBuIfy Nft'ov^ jfli^'Crkjlaftfle due to K 
"l^m\ mm^^^WMCniMi felt that the ' I 

7; patSU.iled fnV61v^:ln the $-Mlnute §tOi^y 
^ jC^fi.lP^nwtreatm'en^ Xcf b^ilgMifibajit 
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W^l>f OlW'as . However . th'rte'sponlir. 
W'^iil»9,^ii\'0lnfeCPf «n«rtt'redu<j^'| thrmiftb% ' 
. - br:6S^YC0|6V-Sffi<?e dn'(6 Wbuld^liQt ^xpfefcl > 
' tl}^t"t}i^Vedtetlon irf 6nr<jf s v/$uTd ba^ur on ■ 

^ . $jjiim«irjf <>f tliiT/(tOat» 

MO^'W^fi?r^f^'S^t^i^^ jttt •p^'tKat'thefe 

- mental anc^^contral 6t\ \}t^ st^Kdiardlsj^d^^st 
This mh b6rn6 t\xt fi^ thd data. 



study did not result In significant gains for tho 
experimental §,3 over the control §^s on the 
Lorge-Thorndlke Group Intolllgenoe Test of the 
California Reading Test, It (s sugge$ted that 
school^reiated variables such as teacher, faclli- 
tle$, and general motivational states In testing 
situations aro stronger than^tb^ ^^flwt.of the 
program on this type of t03t i '-t ^ \" ^ 

The test-taking behavior of theV^^ in'thls" 
study involved considerable random marking / 
The only tests to show slgnUlcaot differences 
between the experlmeVt^l'af\d'^d6Alfol "groups - 
were those adrolni^teredtloTi tfri^'^^^^^ r 
'situation* Furth0r^fva|tfati6b ^ 
or oth^f slrnilar program^ islioul3 care(uuy ioyi^./, 
sidel* the'use of group tests; In assessing iH'^ :, 
status of ^s such a§ those'wh^'|xliV^fer(>4Tiioi-^^ \ 
pated iri th> three Mudlesio datt/v . V ^ ' 
/ Slnc^the Sasio^^teps/dOfiU:^!;^^^ ' . ^ 

: t^lmilav to th^ basic sto^/ bulUri^d fey msny 
bth^Freadirig sf^^cUiftti (althova^h th^ d^t||ls 
may differ greatlyjf ^ 
that rel^tlvMy^gyosVm^$¥Qferi\ft»Kt$ fr^^ 
IntdUlgf^nd^ tests and reading t^'ltJ:Wut4$<>t,; ' ^ 
show mticVdUf^rencO o^tw^eh tV$J&3^p«;|ni^^^ 
arid contfSl groups, , / <;^^y ^ cJf^^l'^'^\''^ 

cti thirty ft Data . ^ > V 






signffioant difference's noted did favor the 
itiaterial reinfojrqerpeni groMPS^,:,^^^^^^^^^ 

Thd ^ecQnd hy^fhe|l0 lUt^BilHlfj^^^^ 
WdOlB^fc^ h|>?dUb^^^^ 
aue to tJfe effect Of VhV Typ^ bt.1^^^^ 
mer^t' factor* Thls'hyp6thesi$ >va"s rfot iif^tX^^ 
The additidn of monejary feinforoenfent to \he'^ 
other relnfofceri ^ - ^ ^ ' ^ ^t-.^-^ v. . . 



Test-^ sirnititjaWtrfeMmfent 6^fects 




<yduId,CCf<>'ii'J<l« This wa$*'lhe case, thfe ex- 




ii • 

Si 

1 



#?tp'el'lmentli| S,s'l]iaK'^WIhbVfe'by the con- 
■ tdl'isf*thG'l>"'thVrtr'§t hi^(56th%sls was sup- 

:-efl8lliW6"^?a'f6e6&(iUl6l^ Mil of its pSr- 
' t1fdf^% m:l!tt|tloj»s where \U w^rds are 

incfedS^1a^tfif^^-€jffydk?Wds in 

jgpM^^^^^^BffPtfs'ffl.wof^' 
afclffs Ijra'W^^f^Wicsh resulted fronf this 



(sud}i a8.^th©i6iflf«*f 

aduU', Velfea$e' fr^m 'the re'^oiar 'MSiit^dm^f/^^. 
pralsy',, th'6 formal response*Oohtlh^ent',awar<l* 
ing of tokens, and th& ?iraphs of tokens .'C 
awarded sh<i<vlng the pro^iress mi«de) '^ld not 
hav^ a significant effect on^ those beh^viots 
measured by th"e,test4 used. 

In gdtie'ral, the'Vesponsfe data derived from 
the perforrrtaftc^ e>t Sk Ih' th^ pfec^^Uf-^Vshb^ . 
that theffm^lo^ wds ade^uMff^ilT^'Slii;" ^ 
the dufves''f§Klhl rnean w'mber ofrell^w^s ■ 
made by feaKh* exp^^rli^fentai ^tp\ip api^jli*sS§-" 
slons shdVthat'ihe Irat^ '^f l'eisfK>hdiri9 IM'^r 
remains c6ft9tVf\^,^||-'v^[|Jh' th6 tM'^Pmi^- 
Exp6rlmentai%d\itf/'^?l'rt'e?eas6s< as witfi''tho^ 
oth'er threo g^foupsT tlits Tfi |^o76yen1k1io€§f?'tflo 
materiaf^ become more dlfficutt'as |, progresses 
through the lessons . 
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DISCUSSION OF DATA 
INTERNAL TO THE PROGRAM 

Cenef^t Findings 

Over the course of the experiment, each S 
(except one S. in the EMR-Money-Experlmental 
group) received 32,5 hours of training, During 
this period the mean number of responses for 
the EMR-Points-Experimental group was 24,045 . 
The EMR*-Monoy-ExDerJmenlal group made an 
average of over 40,429 reading responses 
during the same period, The figures for the 
NRR-Money-^Experlmental group and the NRR- 
Points-Experimental group were 57, 4i8 and 
62,779, respectively, These figures are below 
those for §,$ in the Staats and Butterfield (1965) 
study and the Staats ot al, (1967) study. In 
those tivo studies the .*.ean number of responses 
ranged from about 65 , 000 responses made during 
40 hours of training by the adolescent £ in the 
first study to an average of over 94,000 re- 
sponses made by the 18 adolescent Ss during 
an average of 38. 2 hours of training in the 
second $tudy. 

One explanation for the Jower total number 
of reading responses made by the §,s In this 
study compared to the Ss in the earlier study 
may be that the 18 S s in the Starts et al, (1967) 
study had a higher mean score on the 100-WRT 
Test than the 24 experimental $s in this study 
(69 versus 38,7) * This variable was estab- 
lished as a good predictor of S.sr behavior in 
the program. 

Even though the response rate was lower 
for the Ss participating in this study it is an 
important demonstration that these younger Ss 
did make a large number of responses over an 
extended period of time. Procedures such as 
the reinforcement system described and used 
in this study, which permit an extensive in- 
vestigation of complex behaviors , are an im- 
portant consideration in the study of educational 
variables. 

As mentioned in the Results section there 
were two retention tests built into the proce- 
dures to measure the retention of the words 
trained in the Individual Wofd Phase, On the 
first of these the rank order of the retention 
scores of the four experimental groups matched 
their raoJc order on iM lOp-WKT Test pretest 

t^'lM'^Yd^^ fanl'fe of-fferceniages of 

woras¥§(^ift^"wa$ from 69^ to 83% i ^The rank 
WiffW^^M^^^MKi basis bl tKe IdHg - - : 

t^iftrtan^^^^^^ oir;tfiriGb>WRT le^i i^retest 
6^fes; 1*h§^fange allfiese percentages was 
from 40% to 67%, 



From these scores it is clear that the 100*: 
WRT Test predicts §.s performance in a word 
learning task not only initially (the two align- : 
ments were exactly the same on the 100-WRT 
Test pretest scores and the percentage of cor- 
rect responses first time through in the Indi- 
vidual Word Phase), but also with respect to 
relatively long-term retention measures. The 
percentages retained by all groups showed that 
considerable learning had taken place during 
the program. Even though a criterion of one 
correct> unprompted response was used in train- 
ing, the EMR Ss retained over a short time span 
an average of 70,5% of the words missed ini- 
tially and trained on and 43% of these same 
words over a Jonger time (approximately one 
week). These figures are lower than those re- 
ported by Staats et al, (1967) for their lowest 
group. However, since the averag-5 100-WRT 
Test score for that group was hivibar (43; 2 as 
compared to 18,1 for the two EMa groups in this 
study), one would expect such differences* 

The corresponding percentages for the NRR 
groups are higher, These S.S retained an average 
of 78,5% of the words trained on in the short- 
term retention task and an average of 65% of the 
words on the long-term task . These figures 
compare favorably with the low group and are 
quite similar to the middle group in the Staats 
et al, (1967) study. This is true even though 
the S,s in this study are younger. The relatively 
high percentages of words retained after training 
demonstrate the usefulness of these training pro- 
cedures in increasing in a permanent fashion the 
reading vocabulary of low ability Ss , 

The third hypothesis stated that there would 
be no differences with respect to the measures 
internal to the procedures (such as error rates, 
number of reading responses made, etc) be^ 
tween the materially reinforced and nonmaterlally 
reinforced experimental groups. The data do not 
fully support this hypothesis, An analysis of 
the total reading responses made using the lOO- 
WRT Test pretest scores a^ a covarlate yielded 
a significant two-wAy interaction involving Type 
of Subject and Type of Reinforoemeht, The EMR- 
Money-Experimental group made many more re* 
sponses than the EMR-Points-Experlmental group. 
The suggest ion is strong "that the addition of 
monetary reinforcement to the procedures sig- 
nihcantly incf eased the performance of EMR Ss 
as measured ^i^^^^ variable, 

The NRM V^O^^^^^ not differ to a$ great an 
extent. The NRR-Money-txperlrftentai grolip 
made fewer mp6fi^4k than the NRR-J^^iftClV: 
Experimental orouf», - Thes$ daU' l(id(;is|^^''tKat 
the adclltion 6f monetary reiftf6f^c||i|^fSW not 
increase the s^eed of reading wltlf MVSs , 
However, as i>erttloned eaHieir/ t>ie response- 



tcontlngent monetary roinforcement affected the 
accuracy of Ss, In this program an error re- 
sulted not only in having Ss repeat materials, 
but also in a reduction in the amount earned, 
6oth NRR experimental groups improved in 
reading accuracy more than their corresponding 
control groups.' However, the amount of im- 
provement was greater for the NRR-Money- 
Exporlmental group* 

The Amount of Reinforcement 
Per Residing Response 

The data in Figure 2 sgpport In general the 
earlier finding of Staats and Butterfield (1965) 
and Staats et al. (1967) that the amount of 
reinforcement per response decreased as Ss 
progressed through the program . t This result 
is In part an answer to the frequent question 
concerning the use of extrinsic reinforcement 
In training # that is that the may become 
dependent upon the relnforcers, It may be 
suggested that sophisticated methods may be 
designed to produce the desirable, behavior 
with no lasting dependence upon an artificial 
system of reinforcement. 

the EMR-Polnts-Experimental group, how- 
ever; did show some dependence* This excep- 
tion may be explainable on the basts of the 
larger percentage of errors made by this group, 
and/or the more liberal use of bonuses by the 
Instructional technicians administering the 
program to this group* 



The actual amount of total money earned on 
the average by the EMR-Money-Experimental 
group Ss was $12,34. Thl$ was considerably 
below the average amount earned by the total 
group of Ss In the Staats et al . (1967) study. 

The totals were not presented for groups in 
that report so It is not possible to determine 
whether the low group earned less than the 
Other groups , It is reasonable to assume that 
this would have been the case If the bonus 
system had not been used. Because the EMR- 
Money-Experimental group made fewer responses 
than the low group In the Staats et al, study It 
Is consistent that they earned a lower amount 
especially since the bonus system used In this 
study did jQbt ensure a certain minimal amount 
earned per day as was the case In the Staats 
etal,* study.. 

- The NRR-Money-Experlmental group earned 
an average of $1S«30 over the course of the 
experiment, This is also lower than the over- 
all average of the Ss In the Staats et ah 
study. However, as with the EMR ifi , the 
NRR Ss in this study also made fewer responses 
on ihe; average than did the Ss of the Staats 
et al,' study. The increases In the total number 
of reading responses made in each session 
as the program progressed and relatively low 
error rates suggest that the differences in the 
amount earned by th^ experimental g^s In the 
two studies is not a critical difference. 
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